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Abstract 

o : 

psj , This paper is aimed at extending the Hoo Bounded Real Lemma to stochastic sys- 

^ \ tems under random disturbances with imprecisely known probability distributions. The 

O \ statistical uncertainty is measured in entropy theoretic terms using the mean anisotropy 

functional. The disturbance attenuation capabilities of the system are quantified by the 
' anisotropic norm which is a stochastic counterpart of the Tioo norm. A state-space suf- 

ficient criterion for the anisotropic norm of a linear discrete time invariant system to be 
bounded by a given threshold value is derived. The resulting Strict Anisotropic Norm 
Bounded Real Lemma involves an inequality on the determinant of a positive definite 



Q \ matrix and a linear matrix inequality. It is shown that slight reformulation of these con- 

ditions allows the anisotropic norm of a system to be efficiently computed via convex 
' optimization. 

o . 
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O ■ Dedicated to the blessed memory of our comrade and colleague Eugene Maximov. 

1 Introduction 

■ The anisotropy of a random vector and the anisotropic norm of a system are the main concepts of 
the anisotropy-based theory of robust stochastic control originally developed by LG. Vladimirov 
and presented in [1]-[3J. 

The anisotropy functional considered there is an entropy theoretic measure of the deviation 
of a probability distribution in Euclidean space from Gaussian distributions with zero mean and 
scalar covariance matrices. The mean anisotropy of a stationary random sequence is defined as 
the anisotropy production rate per time step for long segments of the sequence. In application 
to random disturbances, the mean anisotropy describes the amount of statistical uncertainty 
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which is understood as the discrepancy between the imprecisely known actual noise distribution 
and the family of nominal models which consider the disturbance to be a Gaussian white noise 
sequence with a scalar covariance matrix. 

Another fundamental concept of I.G. Vladimirov's theory is the a-anisotropic norm of a 
linear discrete time invariant (LDTI) system which quantifies the disturbance attenuation ca- 
pabilities by the largest ratio of the power norm of the system output to that of the input 
provided that the mean anisotropy of the input disturbance does not exceed a given nonnega- 
tive parameter a. 

In the context of robust stochastic control design aimed at suppressing the potentially 
harmful effects of statistical uncertainty, the anisotropy-based approach offers an important 
alternative to those control design procedures that rely upon a specific probability law of the 
disturbance and the assumption that it is known precisely. 

Minimization of the anisotropic norm of the closed-loop system as a performance criterion 
leads to internally stabilizing dynamic output feedback controllers that are less conservative 
than the 1-Loo controllers and more efficient for attenuating the correlated disturbances than the 
7^2 (LQG) controllers. A state-space solution to the anisotropic optimal control problem derived 
by I.G. Vladimir ov in |1] results in a unique full-order estimator-based controller and involves 
the solution of three cross-coupled algebraic Riccati equations, an algebraic Lyapunov equation 
and a mean anisotropy equation on the determinant of a related matrix. Solving this complex 
system of equations requires application of a specially developed homotopy-based numerical 
algorithm [S]. 

The anisotropic suboptimal controller design is a natural extension of this approach. Instead 
of minimizing the anisotropic norm of the closed-loop system, a suboptimal controller is only 
required to keep it below a given threshold value. Rather than resulting in a unique controller, 
the suboptimal design yields a family of controllers, thus providing freedom to impose some 
additional performance specifications on the closed-loop system. 

The anisotropic suboptimal control design requires a state-space criterion for verifying if the 
anisotropic norm of a system does not exceed a given value. The Anisotropic Norm Bounded 
Real Lemma (ANBRL) as a stochastic counterpart of the "Hoo Bounded Real Lemma for LDTI 
systems under statistically uncertain stationary Gaussian random disturbances with bounded 
mean anisotropy was presented in [B]. The resulting criterion has the form of an inequality 
on the determinant of a matrix associated with an algebraic Riccati equation which depends 
on a scalar parameter. A similar criterion for linear discrete time varying systems involving 
a time-dependent inequality and difference Riccati equation can be found in [?]. This paper 
aims at improving numerical tractability of ANBRL by representing the criterion as a convex 
optimization problem. These results are applied in [S] to design of the suboptimal anisotropic 
controllers by means of convex optimization and semidefinite programming. 

The paper is organized as follows. Section [2] provides the minimum necessary background 
on the anisotropy of signals and anisotropic norm of systems. Section [3] establishes the Strict 
Anisotropic Norm Bounded Real Lemma (S ANBRL) which constitutes the main result of the 
paper. In Subsection 13.21 we slightly reformulate the SANBRL for efficient computation of 
the anisotropic norm of a system by convex optimization. Subsection 13.31 considers and 
1-Loo norms as two limiting cases of the anisotropic norm. It is shown that in these cases the 
SANBRL conditions transform to the well-known criteria for 7^2 and "Hoo norms, respectively. 
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Section H] presents benchmark results to compare the novel computational algorithm with an 
earlier approach which employs a homotopy-based algorithm for solving a system of cross- 
coupled nonlinear matrix algebraic equations developed by I.G. Vladimirov [5j. Concluding 
remarks are given in Section |5l 

1.1 Notation 

The set of reals is denoted by M, the set of real (n x m) matrices is denoted by M"^"*. For a 
complex matrix M = [rriij], M* denotes the Hermitian conjugate of the matrix: M* := [m*j]. 
For a real matrix M = [rriij], denotes the transpose of the matrix: M"^ := [rriji]. For 
real symmetric matrices, M y N [M )^ A^) stands for positive definiteness (semidefiniteness) 
of M — A^. The trace of a square matrix M = [rriij] is denoted by trM := Ylk'^kk- The 
spectral radius of a matrix M is denoted by p(M) := max^ |Afc(M)|, where Afc(M) is k-th 
eigenvalue of the matrix M. The maximum singular value of a complex matrix M is denoted 
by a{M) := a/ XmsixiM*M). /„ denotes a {n x n) identity matrix, 0„xm denotes a zero (n x m) 
matrix. The dimensions of zero matrices, where they can be understood from the context, will 
be omitted for the sake of brevity. 

The angular boundary value of a transfer function F{z) analytic in the unit disc of the 
complex plane |z| < 1 is denoted by 

F{u) := lim F(re*^). 

r— 5-1 — 

^pxm ^gj^Qi^gg ^Y^Q Hardy space of {p x m)-matrix-valued transfer functions F{z) of a complex 
variable z which are analytic in the unit disc |2;| < 1 and have bounded ^2 norm 

\\Fh:= JtT{F{co)F*{u))du 

^pxm figjiotes the Hardy space of {p x m)-matrix-valued transfer functions F{z) of a complex 
variable z which are analytic in the unit disc |z| < 1 and have bounded Hoo norm 

||F||oo := supa(F(z)) = esssup a(F(c(;)). 

2 Basic concepts of anisotropy-based robust performance 
analysis 

For completeness of exposition, we provide the minimum necessary background material on the 
anisotropy of signals and anisotropic norm of systems. Detailed information on the anisotropy- 
based robust performance analysis developed originally by I.G. Vladimitov [21 13] can be also 
found in [9l[IO]. 

Let denote the class of square integrable M™- valued random vectors distributed absolute- 
ly continuously with respect to the m-dimensional Lebesgue measure mes^- For any W G 
with PDF /: M™ ]R_|_, the anisotropy A{W) is defined in [10] as the minimal value of the 
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relative entropy T){f\\pm,\) with respect to the Gaussian distributions pm,x in with zero 
mean and scalar covariance matrices XI„ 



A{W) := minD(/|b^,A) = ^ In (—E\wA - h{W), (1) 
A>o 2 \ m J 

where E denotes the expectation, h(l^) denotes the differential entropy of W with respect to 
meSm [H]- It is shown in [10] that the minimum in ([1]) is achieved at A = E|iyp/m. 
Let W := ( 

"U^fc)— oo<fc<+oo be a stationary sequence of vectors G interpreted as a 
discrete-time random signal. Assemble the elements of W associated with a time interval [s, t] 
into a random vector 



s:t 



(2) 



It is assumed that Wo:7v is distributed absolutely continuously for every N ^ 0. The mean 
anisotropy of the sequence W is defined in [10] as the anisotropy production rate per time step 
by 

A(H'):= lun (3) 

Let G'^{fi, S) denote the class of M^-valued Gaussian random vectors with mean Ewk = and 
nonsingular covariance matrix cov(wfc) := E{wk — fi){wk — fJ^)^ = S. Let V := (ffc)-oo<A;<+oo 
be a sequence of independent random vectors Vk G G™(0,/m), i.e. an m-dimensional Gaussian 
white noise sequence. Suppose W = GV is produced from V hj a stable shaping filter with 
transfer function G{z) G T-C^^^ . Then the spectral density of W is given by 

S{uj) := G{uj)G{oj)\ -71 ^u<7i, (4) 

where G{uj) := lim^^i- G'(re*'^) is the boundary value of the transfer function G{z). It is shown 
in [31, [9] that the mean anisotropy ([3j) can be computed in terms of the spectral density (jl]) and 
the associated I-L2 norm of the shaping filter G as 



A(H') = -J^Xj.>det^d.. (5) 

Since the probability law of the sequence W is completely determined by the shaping filter G 
or by the spectral density 5*, the alternative notations A(G) and A{S) are also used instead of 
A{W). 

The mean anisotropy functional is always nonnegative. It takes a finite value if the 
shaping filter G is of full rank, otherwise, A{G) = +00 [31 19]. The equality A{G) = holds 
true if and only if G is an all-pass system up to a nonzero constant factor. In this case, spectral 
density (j4]) is described by 5'(ci;) = Xlm, — vr ^ < vr, for some A > 0, so that is a Gaussian 
white noise sequence with zero mean and a scalar covariance matrix. 

Let F G "H^™" be a LDTI system with an m-dimensional input W and a p-dimensional 
output Z = FW. Let the random input sequence be given hj W = GV, where, as before, V is 
an m-dimensional Gaussian white noise sequence. Denote by 

ga:={Gen^''^:AiG)^a} (6) 
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the set of shaping filters G that produce Gaussian random sequences W with mean anisotropy 
(E]) bounded by a given parameter a ^ 0. 

The a-anisotropic norm of the system F is defined by I.G. Vladimirov as [31 E] 

\\FG\\2 

l\Fl\a ■= sup (7) 

It is shown in [3j that the a-anisotropic norm of a given system F G "H^™" is a nondecreasing 
continuous function of the mean anisotropy level a which satisfies 

Fl<: hm l\F\l = \\F\U (8) 



These relations show that the and Hoc norms are the limiting cases of the a-anisotropic 
norm as a — )■ 0, +oo, respectively. 



3 Strict anisotropic norm bounded real lemma 

Let F G be a LDTI system with an m-dimensional input W , n-dimensional internal state 

X and p-dimensional output Z governed by 



Xk+l 




'A 


B 




Xk 






C 


D 




_Wk_ 



(9) 



where A, B, C, D are appropriately dimensioned real matrices, and A is stable (its spectral 
radius satisfies p{A) < 1). Suppose the input sequence is a stationary Gaussian random 
sequence whose mean anisotropy does not exceed a ^ 0, i.e. W is produced from the m- 
dimensional Gaussian white noise V with zero mean and identity covariance matrix by an 
unknown shaping filter G which belongs to the family Qa defined by ([6]). 



3.1 Main result: a convex formulation 



The theorem below (SANBRL) provides a state-space criterion for the anisotropic norm of the 
system ([9]) to be strictly bounded by a given threshold 7. 

Theorem 1. Let F G "H^™ he a system with the state-space realization where p{A) < 1. 
Then its a-anisotropic norm ^ is strictly hounded hy a given threshold 7 > 0, i.e. 

\\F\\a < 7 (10) 
if there exists q G (0,min(7~^, such that the inequality 

- (det (/^ - B^RB - qD^D))^/"" < -(1 - q^^)e^''/"' (11) 

holds true for a real {n x n) -matrix R = R7 >- satisfying the linear matrix inequality 



A^RA - R A^RB 
B^RA B^RB - /„ 





- - 


+ q 





[C D ] ^ 0. 



(12) 
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Remark 1. Note that the constraints described by the inequalities 177]) and [W\) are convex 
with respect to both variables q and R. Indeed, the function — (det(-))^/'™ of a positive definite 
(m X m)-matrix on the left-hand side of 07]) is convex IT^ [TSf . 

Before to proceed to proving the theorem, let us recall a nonstrict formulation of ANBRL 
presented in [B]. 

Lemma 1. [6J Let the assumptions of TheoremUl be satisfied. Then 

l\Fl\a ^ 7 (13) 
if and only if there exists q G [0,min(7^^, ||-F||oo^)) such that the inequality 

- ^lndet((l-g72)S) ^ a (14) 

is satisfied for the matrix S associated with the stabilizing (p{A+BL) < 1) solution R = R^ )p 
of the algebraic Riccati equation 

R = A^RA + qC^C + L'^J:~^L, (15) 
L := E{B^RA + qD'^C), (16) 
S := {Im- B^RB -qD^D)-\ (17) 

Remark 2. Note that the matrix S defined by p7| ) is positive definite if and only if q < ||-F||oo^. 
For any such q, the left-hand side of the inequality 

— In det S ^ m In (1 — g7^) + 2a 

equivalent to p^l ) is nonpositive since )p 1^- Therefore, any q satisfying p^l ) must also satisfy 

7-2(1 - e-2'^/'") ^ g < 7-2. (18) 

For every admissible value of q, the stabilizing solution R of the Riccati equation / l73]) -p7|) is 
unique, so that there is a well-defined map q^ R^. The set of those values of q for which the 
pair {q, Rq) satisfies the inequality [14^ , form an interval [q*,q*] whose endpoints, for a given 
system F, are functions of a and 7. This interval becomes a singleton q^, = q* if and only if 
7 ~ III -^111 a- -^'^^ ^^'^^ reason, it is not hard to derive the necessary and sufficient conditions for 
the inequality in / I7gj) to be strict. In this case the nonstrict inequality in becomes the strict 
one resulting in similar modification of l[T^) . 

To prove the main result, first we will need the following assertion: 

Lemma 2. Let F e "H^™" be a system with the state-space realization where p{A) < 1, 
and let the real positive values 7 and a be given. Suppose that there exist a real {n x n) -matrix 
R = R^ >- and scalar value q G (0,min(7-2, H-^H^^)) such that 

A^RA-R + qC^C+{A^RB + qC^D){Im-B^RB -qD'^D)-\B^RA + qD'^C) ^0, (19) 

Im - B^RB - qD'^D y 0, (20) 
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and 

In det ( J„ - B^RB - qD^D) > m In (1 - q-f^) + 2a. (21) 
Then there exists a stabilizing solution R = R^ )p to the algebraic Riccati equation 

A^RA -R + qC^C + {A^RB + qC^ D) (/„ - B^RB - qO'^Oy^B^RA + qD^C) = (22) 
such that 

Im - B^RB - qD'^D y (23) 

and 

In det {Im - B^RB - qD'^D) > m In (1 - qj^) + 2a. (24) 

Moreover, R R. 

Proof. Let us fix q. From f ll9l) it follows that there exists a real {n x n)-matrix Q = >- 
such that 

A'^RA-R + qC^C + Q + {A^RB + qC^D){Im-B^RB-qD'^D)-\B^RA + qD'^C) = 0. (25) 

Note that fl20|) also yields Im — qD^D >- 0. Then, by virtue of Lemma 2.1 in [H] there exists 
a real (n x n)-matrix R = R^ )p satisfying fl22|) such that fl23|) holds true and all eigenvalues 
of the matrix 

'A:=A + B{Im - B^RB - qD'^Oy^B^RA + qD'^C) 
lie within the closed unit disc. Furthermore, we have 

0^R=4R. (26) 

The inequalities fl2ip and fl24p can be rewritten as 

det (Im-B^RB-qD'^D) > {1 - q-f^re^"", (27) 
det {Im - B^RB -qD'^D) > {1 - q-^^)"'e'^\ (28) 

respectively. From fl2^ - fl2Sl) it can be seen that 

det {Im - B^RB - qD^D) ^ det (/„ - B'^ RB - qD^ D) > (1 - q-i'^)'^e^'' 

which proves fl2^ . Now, let us show that the matrix A is actually stable, i.e. the matrix R is the 
stabilizing solution of the algebraic Riccati equation f l2^ . Denoting P := —R and P := —R, 
the equations (l25l) . (122|) can be rewritten as 

A^PA - P - gC^C - g - (A^PP - qC^D){Im - qD'^D + B^PB)-\B^PA - qD^C) = 0, 

A^PA - P - gC^C - (A^PP - qC'^D){Im - gP^P + B'^PB)-\B'^PA - qD'^C) = 0, 

respectively. Applying Lemma 3.1 from [15] we have that the matrix P — P must satisfy the 
following equation: 

P-P = A^{P - P)A + A^{P - P)B{Im - qD'^D + B"^PB)-^B^{P - P)A + Q. (29) 
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Suppose that the matrix A is not stable, i.e. there exists a nonzero vector ^ G and scalar 
value A, |A| = 1, such that A( = X(. Then from (12^ it follows that 

C^A^iP - P)B{I^ - qD'^D + B^PB)-^B^{P - P)AC + C^QC = 0. (30) 

Since by (ES]) and ([20]) 

C'^A^(P - P)B{I^ - qD^D + B^PB)-^B^{P - P)AC 

= C'^A^iR - R)B{Im - qD'^D - B^RB)-^B^{R - R)AC ^ 

for all nonzero C, from (ED]) it follows that CQC < for all nonzero (. This contradicts to the 
assumption that Q y 0. Therefore, the matrix A is stable, i.e. the matrix R is the positive semi- 
definite stabilizing solution to f l22]) . Finally, from fl29]) it follows that R -< R, which completes 
the proof. □ 

Proof of TheoremUi Note that by virtue of the Schur Theorem (see e.g. p!6]fT7]) the linear matrix 
inequality is equivalent to ([19]), ((20]) for all q e (0, min(7-^ The inequality (Jn]) 

can be rewritten as f l2T]) and the strict form of f|T^ . By applying Lemma |2l we conclude 
that in this case there exists a stabilizing solution to the Riccati equation f l2^ such that the 
inequality ( 124]) holds true. Then, by virtue of Theorem 1 in [6] (see Lemma[l]), the inequality ( ITO]) 
also holds, which was to be proved. □ 

Remark 3. A solution to the inequalities (I77]j. fT^) of TheoremUl can be found by means of 
available software packages for convex optimization that allows the convex function — (det(-))^/'^ 
to be used not only as an objective, but also in constraints /7P|/ . 



3.2 Computing anisotropic norm by convex optimization 



Being convex in both variables q G (0,min(7^^, ||-F||Jxd^)) and Ry 0, the conditions (ITT]) . (fT2]) of 
Theorem [H are not directly applicable for computing the minimal 7 such that the inequality fill I) 
holds true because of the product of q and 7^ on the right-hand side of the inequality (ITT]) . One 
of possible ways to overcome this obstacle is to apply an auxiliary search algorithm (for example, 
the interval bisection method) for finding the minimal value of 7 such that the inequalities f|TT]) . 
(|T2]) are solvable. This, however, would inevitably increase the required computation time. 
Instead of doing so, let us multiply both inequahties 



-(det (/„ - B^RB - qD^D))^'"^ < -(1 - q-f^)e^''/'^ , 

[C D] ^0 





- - 


+ q 





A^RA - R A^RB 
B^RA B^RB - I„ 

of Theorem [1] by 77 := q^^ > recalling that q > due to the strict localization in (fTSi) . see 
Remark [21 By rescaling the matrix i? as $ := t]R, we can make the SANBRL constraints linear 
in 7^. 

Theorem 2. Suppose the assumptions of Theorem U\ o,re satisfied. Then the a-anisotropic 
norm ^ of system F is strictly bounded by a given threshold 7 > 0, i.e. 



\F\la < 7 
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if there exists t] > 'j'^ such that the inequality 

r] - (det(e-2"/'"(r//„ - 5^$^ - D^D)))^/"" < 7^ (31) 
holds true for the real {n x n) -matrix $ = $^ >- satisfying the linear matrix inequality 

A^<^A - $ + C^C A^<I>B + C^D 



B^<!>A + D'^C B^^B + D'^D - t]I„ 



^ 0. (32) 



Remark 4. With the notation 7 := 7^, the conditions of Theorem\^ allow the minimal 7 to he 
computed from a solution to the following convex optimization problem: 

find 7* = inf7 
over $,77,7 satisfying ^M), [3^) . 



Once the minimal 7^ is found, the a-anisotropic norm of the system F is computed as 

WFWa = V%- (34) 

Note tfiat, in contrast to tlie results of [31 19], the presented technique for computing the 
a-anisotropic norm does not employ the solution of a complex system of cross-coupled equa- 
tions via a homotopy-based iterative algorithm [5] . In Section H] we will consider benchmark 
results which demonstrate advantages and drawbacks of our convex optimization approach in 
comparison with the earlier method. 



3.3 Limiting cases 

Let us now consider the conditions of Theorem |2] in two important cases when the mean 
anisotropy level a is equal to zero and tends to infinity, respectively. Since the scaled norm 
and Hoo norm are two hmiting cases of the a-anisotropic norm as a — )■ 0, +00 (see ([8])), the 
inequalities (EI]), ( 15^ are expected to provide the criteria for verifying if the scaled "^2 norm 
and "Hoo norm of the system F are bounded by a given threshold 7. 

First, we study the case of zero mean anisotropy level under the convex constraints of 
Theorem |2l when the inequality fl3T]l becomes 

T] - (det (r//^ - B^<I>B - D^D))^/"^ < 7^. (35) 

By applying the arithmetic-geometric mean inequality to the eigenvalues of the matrix rjlm — 
B^^B - D^D y 0, it follows that 

(det (r]I^ - B^'^B - D'^ D))^'"" <: — tiir]!^ - B^<^B - D^D) 

m 

(see e.g. [ISl p. 275].) So, from ( 15^ it follows that 

T]-— ii{rilm - B^<I>B - D^D) < 7^ 
m 

or, equivalently, 

ti{B^^B + D^D) < 77172. (36) 
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By virtue of the Schur Theorem, the LMI (l32l) is equivalent to 



B^^B + D^D - Tflrr, -< 0, 



which imphes that 



A^^A - $ + C^C -< 0. 
Now note that the fulfillment of the inequalities fl36l) and fl37|) is equivalent to 

1 



|F||2 < 7 



(37) 



(38) 



(see e.g. [IT].) 

In the case when a — )■ +oo, the localization 7^ < 77 < 7^/(1 — e"^"/™) yields 77 — )■ 7^; the 
inequality f l3T]) becomes ineffective. In this case, by rescaling the matrix $ := 7$ and the Schur 
Theorem, the LMI f|T2l) can be rewritten in the form 



A^^A - $ 

S^iS - 7J„ 



-lip 



-< 



(39) 



which is well-known in the context of the discrete time Hoo control (see e.g. [TS].) This fact 
is closely related to the convergence lima_j._|_oo If -^11 a — 1 1 -^11 00 in & whereby the inequality (|TOi) 
'approximates' 



< 7 



(40) 



for sufficiently large values of a. Thus, in the limit, as a — t- +00, Theorem [2] becomes Tioo 
Bounded Real Lemma which establishes the equivalence between (HUl) and existence of a positive 
definite solution to the LMI (EHl). 



4 Numerical experiments and computational benchmark 

We have performed extensive numerical experiments to test the efficiency and reliability of 
the proposed convex optimization technique for computing the a-anisotropic norm of LDTI 
systems. The computations, whose results are provided below, have been carried out by means 
of MATLAB 7.9.0 (R2009b) and Control System Toolbox in combination with the YALMIP 
interface [I9] and SeDuMi solver [20] with CPU P8700 2 x 2.53GHz. 

Let us first note that the number of variables of the resulting convex optimization prob- 
lem (!3T|) - (!M|) is |n(n + 1) + 2 and does not depend on the dimensions of the system input and 
output, whereas the size of the LMI ( 152]) is (n + m) x {n + m) and does not depend on the 
system output dimension p either. The number of unknown variables in the equation system 
of [21 [9] is n{n + !) + !. For this reason, we carried out the computational experiments for some 
fixed p. Using the MATLAB functions drss and randn, we randomly generated 100 state-space 
realizations of LDTI systems with random (positive) sampling time for each combination of the 
dimensions from the sets n = {1 . . . 12}, m = {3,4,5}, p = 2. Thus, we obtained 3600 stable 
realizations, possibly with poles arbitrarily close to the boundary of the unit circle (up to the 
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machine epsilon). For each of them, we computed the a-anisotropic norm via the solution of the 
convex optimization problem (COP) of Section \^72\ and by I.G. Vladimirov's homotopy-based 
algorithm (HBA) [S] for solving the system of three cross-coupled nonlinear matrix algebraic 
equations derived in [3l [9]. The computations were carried out for 27 different values of the 
input mean anisotropy level a G [0,20]. Thus, the compared algorithms run 97200 times. The 
required accuracy (tolerance) in all computations was set to 10~^. 

In computing the a-anisotropic norm by solving the convex optimization problem we consid- 
ered a run to be failed if the optimization problem appeared to be infeasible or an unexpected 
solver crash happened. If the issues were caused by the solver itself, but the solution was, 
nevertheless, found, the run was considered to be successful. In applying the homotopy-based 
algorithm we stopped computations and concluded that the algorithm fails if the prescribed 
accuracy had not been achieved after 2500 iterations. Also, a run of the homotopy-based al- 
gorithm was considered to be a failure if one of the equations appeared to be insolvable or 
an unexpected crashes of the MATLAB solvers for Lyapunov and Riccati equations happened. 
Here, by the 'solver crashes' we mean those which do not originate from a particular numer- 
ical algorithm used. Nevertheless, these events have also been taken into consideration while 
assessing the reliability. 



Table 1: Mean CPU time required; n = 1 . . . 12, m = 3, p = 2 





COP 


HBA 


n 


Mean CPU 


Mean YALMIP 


Mean SeDuMi 


Mean CPU 




time (s) 


time (s) 


time (s) 


time (s) 


1 


0.4840 


0.2652 


0.1161 


0.4448 


2 


0.7944 


0.4411 


0.1406 


0.5530 


3 


1.2102 


0.6618 


0.1690 


1.0521 


4 


1.5484 


0.8503 


0.1722 


0.9302 


5 


2.1429 


1.1148 


0.2851 


1.2997 


6 


2.5697 


1.4755 


0.2555 


1.7038 


7 


2.9299 


1.6200 


0.2245 


1.4774 


8 


3.4697 


1.8860 


0.2418 


1.6226 


9 


4.0750 


2.1866 


0.2515 


1.8937 


10 


4.8381 


2.5122 


0.2794 


1.9718 


11 


5.5680 


2.9051 


0.3054 


2.0984 


12 


6.3453 


3.2828 


0.3387 


2.8205 



The benchmark results for m = {3,5} are presented in Tables [TH5] and Figure [H The 
results for m = 4 do not contradict the general tendency and, for the sake of brevity, are not 
presented here. In Tables [H [21 the mean CPU time required to compute the anisotropic norm 
was calculated as the average value over all realizations of equal dimensions and over a set of 
27 different values of the input mean anisotropy level a G [0, 20]. Comparison of the data shows 
that computation of the a-anisotropic norm from the solution to COP requires on average more 
CPU time than its computation by HBA. Moreover, the average CPU time grows not only with 
the system order n but also with the system input dimension m much faster than that for HBA. 
Furthermore, the time required by the YALMIP interface to form the optimization constraints 
is affected by the number of these constraints which depends on the input dimension m and 
growth considerably with increase of m in comparison with the time required by the SeDuMi 
solver. 

At the same time, the average values in Tables [H [2] do not take into account the growth 
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Table 2: Mean CPU time required; n = 1 . . . 12, m = 5, p = 2 





COP 


HBA 


n 


Mean CPU 


Mean YALMIP 


Mean SeDuMi 


Mean CPU 




time (s) 


time (s) 


time (s) 


time (s) 


1 


0.6575 


0.3234 


0.1317 


0.2111 


2 


1.1681 


0.6147 


0.1588 


0.3328 


3 


1.6782 


0.9088 


0.1730 


0.4330 


4 


2.2269 


1.2423 


0.1936 


0.5451 


5 


2.8304 


1.5783 


0.2162 


0.7714 


6 


3.4233 


1.8830 


0.2088 


0.6867 


7 


4.0856 


2.2377 


0.2345 


0.9555 


8 


5.1935 


2.8440 


0.2464 


1.0044 


9 


6.0724 


3.2426 


0.2739 


1.2394 


10 


7.0646 


3.7505 


0.2942 


1.3387 


11 


7.9707 


4.2034 


0.3230 


1.7716 


12 


8.9616 


4.7629 


0.3615 


1.8914 



CPU time required by COP and HBA (sec) 




CPU time required by COP and HBA (sec; 



10 

Mean anisotropy a 



(a) 




10 15 

Mean anisotropy a 



(b) 



Figure 1: Mean CPU time required to compute the a-anisotropic norm by the convex optimiza- 
tion (COP) and homotopy-based algorithm (HBA); n = {1 . . . 12}, p = 2, m = 3 (a), m = 5 
(b). 
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of the mean CPU time required by HBA over all realizations of equal dimensions as the mean 
anisotropy level a increases. This growth is clearly demonstrated by the diagrams in Figure [H 
where the mean CPU time is shown as a function of the mean anisotropy level a for all groups 
of realizations of equal dimensions. These diagrams also show that the mean CPU time required 
by COP does not change noticeably with the increase of a. 

The data in Tables |3l H] are concerned with the reliability of the algorithms being compared. 
The percentages of successful and failed runs, infeasible problems, as well as runs with numerical 
problems (COP) including the maximum admissible number of iterations (HBA) exceeded were 
calculated as the average value over all realizations of equal dimensions and over the set of 27 
different values of the input mean anisotropy level a G [0, 20]. The analysis of Tables |3l H] shows 
that computation of the a-anisotropic norm from the solution to COP have more successful 
runs than HBA on average. Moreover, all failed runs of the optimization-based algorithm are 
caused by infeasibility of the respective COP. Their fraction corresponds to the percentage 
of realizations with poles located very close to the unit circle in the total number of tested 
realizations. It should be noted that HBA had the same percentage of runs failed because of 
the infeasibility of algebraic Riccati equation. However, this algorithm is also characterized by 
a certain percentage of runs with the maximum number of iterations exceeded and runs which 
resulted in unexpected crashes in the Lyapunov and Riccati equation solvers. 



Table 3: Successful and failed runs; n = 1 . . . 12, m = 3, p = 2 





COP 


HBA 




Succ. 


Failed 


Infeas. 


Numer. 


Succ. 


Failed 


Infeas. 


Max. iter. 


n 


(%) 


(%) 


(%) 


probl. (%) 


(%) 


(%) 


(%) 


exceed. (%) 


1 


100 








5.1538 


85.5385 


14.4615 





9.0385 


2 


99 


1 


1 


4.0385 


81.6923 


18.3077 


1 


10.4231 


3 


90.1154 


9.8846 


9.8846 


5.1154 


70.3462 


29.6538 


9.8846 


12.7308 


4 


95.5769 


4.4231 


4.4231 


7.0385 


75.2692 


24.7308 


4.4231 


11.5769 


5 


92 


8 


8 


9.2692 


70.2308 


29.7692 


8 


12.3462 


6 


91 


9 


9 


12.2692 


66.8846 


33.1154 


9 


15.3846 


7 


94.7692 


5.2308 


5.2308 


16.0769 


68.0769 


31.9231 


5.2308 


14.3077 


8 


88.1154 


11.8846 


11.8846 


15.8077 


67.6154 


32.3846 


11.8846 


13.7692 


9 


92.3846 


7.6154 


7.6154 


18.3846 


63.5385 


36.4615 


7.6154 


16.5000 


10 


88.4231 


11.5769 


11.5769 


21.5000 


62.8846 


37.1154 


11.5769 


13.5000 


11 


89.8462 


10.1538 


10.1538 


21.1154 


65.7692 


34.2308 


10.1538 


12.6923 


12 


91.4231 


8.5769 


8.5769 


26.3077 


66.4231 


33.5769 


8.5769 


16 



Finally, Table gathers together the mean CPU time required and percentages of successful 
and failed runs computed as average values over all realizations irrespective of dimensions for 
different values of the input mean anisotropy level a G [0, 20]. It can be seen that the mean CPU 
time required by HBA grows with increase of a. The same is true in regard to the percentage of 
the HBA runs failed by the maximum number of iterations exceeded. The percentage of HBA 
successful runs decreases considerably as a increases. At the same time, the mean CPU time 
required by COP and the percentage of successful runs of this algorithm change insignificantly 
with the growth of the input mean anisotropy level. 
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Table 4: Successful and failed runs; n— 1...12, m = 5,p = 2 





COP 


HBA 






Failed 


J. • 






Failed 




l\/r a Y t1" fi t* 


fl 




(%) 


(%) 


probl. (%) 








exceed. (%) 


1 


100 








4.1154 


92.0769 


7.9231 





3.6923 


2 


97 


3 


3 


3.7308 


87.1538 


12.8462 


3 


5.0769 


3 


93 


7 


7 


3.6923 


82.1154 


17.8846 


7 


6.0769 


4 


95.8462 


4.1538 


4.1538 


4.4615 


82.9231 


17.0769 


4.1538 


7.9615 


5 


92.6923 


7.3077 


7.3077 


4.6154 


77.4615 


22.5385 


7.3077 


9.6923 


6 


97.7308 


2.2692 


2.2692 


4.8846 


80.7308 


19.2692 


2.2692 


8.2692 


7 


87.3846 


12.6154 


12.6154 


5.1538 


69.6154 


30.3846 


12.6154 


10.6538 


8 


89.9615 


10.0385 


10.0385 


4.5000 


77.9615 


22.0385 


10.0385 


9.9615 


9 


88.3462 


11.6538 


11.6538 


5.4615 


70.9231 


29.0769 


11.6538 


10.5769 


10 


92.7308 


7.2692 


7.2692 


5.9231 


74.8462 


25.1538 


7.2692 


12.2692 


11 


86.5769 


13.4231 


13.4231 


6.9615 


67.6538 


32.3462 


13.4231 


12.6538 


12 


91.3077 


8.6923 


8.6923 


7.9231 


70.2692 


29.7308 


8.6923 


14.3846 



Table 5: Mean CPU time required, successful and failed runs for different values of a; all tested 
realizations 





COP 


HBA 




Mean CPU 


Succ. 


Infeas. 


Numer. 


Mean CPU 


Succ. 


Infeas. 


Max. iter. 


a 


time (s) 


(%) 


(%) 


probl. (%) 


time (s) 


(%) 


(%) 


exceed. (%) 





3.9341 


93.2083 


6.7917 


14.5417 












0.02 


3.6000 


93.2083 


6.7917 


6.7917 


0.2864 


88.7083 


6.7917 


2.3333 


0.04 


3.6098 


93.2083 


6.7917 


6.7917 


0.2400 


89.8333 


6.7917 


1.7500 


0.06 


3.6273 


93.1667 


6.8333 


6.8333 


0.2261 


90.4167 


6.8333 


1.6250 


0.08 


3.6282 


93.1667 


6.8333 


6.8333 


0.2113 


90.7500 


6.8333 


1.4167 


0.1 


3.6246 


93.1667 


6.8333 


6.8333 


0.1893 


91.0417 


6.8333 


1.1250 


0.5 


3.6184 


93.1667 


6.8333 


6.8750 


0.1615 


92.2083 


6.8333 


0.6667 


1 


3.6185 


93.1667 


6.8333 


7.0417 


0.2184 


91.3333 


6.8333 


1.5833 


1.5 


3.6175 


93.0417 


6.9583 


7.1667 


0.2509 


90.9167 


6.9583 


2.0000 


2 


3.6189 


93.0000 


7.0000 


7.2500 


0.3209 


89.8333 


7.0000 


3.0417 


2.5 


3.6195 


92.9167 


7.0833 


7.3750 


0.3574 


89.3750 


7.0833 


3.4583 


3 


3.6179 


92.8750 


7.1250 


7.4167 


0.3926 


88.7917 


7.1250 


3.9167 


3.5 


3.6163 


92.8333 


7.1667 


7.4583 


0.4593 


87.8750 


7.1667 


4.7917 


4 


3.6196 


92.7917 


7.2083 


7.5417 


0.5338 


86.7500 


7.2083 


5.7917 


4.5 


3.6206 


92.7917 


7.2083 


7.6250 


0.5498 


86.3750 


7.2083 


6.0000 


5 


3.6197 


92.7083 


7.2917 


7.7083 


0.6754 


84.3333 


7.2917 


7.6667 


6 


3.6213 


92.5000 


7.5000 


8.0833 


0.7531 


83.1250 


7.5000 


8.4167 


7 


3.6201 


92.3750 


7.6250 


8.3750 


0.9554 


79.9167 


7.6250 


10.7500 


8 


3.6265 


92.2083 


7.7917 


8.8333 


1.1690 


76.5417 


7.7917 


13.0417 


9 


3.6308 


92.1250 


7.8750 


9.3333 


1.4899 


72.0000 


7.8750 


16.3333 


10 


3.6307 


92.1250 


7.8750 


9.8750 


1.7947 


68.0417 


7.8750 


19.7083 


12 


3.6445 


92.1667 


7.8333 


10.6250 


2.4873 


58.7500 


7.8333 


27.4167 


14 


3.6441 


92.2917 


7.7083 


11.2917 


3.1595 


49.3750 


7.7083 


33.6250 


16 


3.6492 


92.1250 


7.8750 


12.2083 


3.8370 


40.5000 


7.8750 


37.5833 


18 


3.6517 


92.0417 


7.9583 


12.7917 


4.4236 


32.8750 


7.9583 


39.6667 


20 


3.6545 


92.2917 


7.7083 


12.9167 


5.1172 


26.5000 


7.7083 


38.2917 
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5 Conclusion 



We have introduced the Strict Anisotropic Norm Bounded Real Lemma in terms of inequahties 
providing a state-space criterion for verifying if the anisotropic norm of a LDTI system is 
bounded by a given threshold value. This result extends the "Hoo Bounded Real Lemma to 
stochastic systems where the statistical uncertainty, present in the random disturbances, is 
quantified by the mean anisotropy level. 

The derived criterion employs the solution of an LMI and an inequality on the determi- 
nant of a related positive definite matrix and a positive scalar parameter. SANBRL in terms 
of inequalities provides a key result which is used for the design of suboptimal (or 7-optimal) 
anisotropic controllers via convex optimization and semidefinite programming to ensure a spec- 
ified upper bound on the anisotropic norm of the closed-loop system (respectively, to minimize 
the norm). It can also be combined with additional specifications for the controllers. 
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